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(54) Method of real-time optimization of control device equipped with fuzzy inference system 

(57) Real-time optimization is conducted for a con- 
trol device having a fuzzy inference system that can 
optimize characteristics of the control device In real 
time, by coding parameters used in the fuzzy inference 
system into chromosomes, and optimizing in real time 
the output of the control device by subjecting the chro- 
mosomes to evolutionary computation. Coding is con- 
ducted by (1) revising a matrix of fuzzy rules used in the 



system by extracting a section from the matrix and cod- 
ing elements of the section into chromosomes; (ii) mod- 
ifying the configuration of the fuzzy rule matrix defined 
by membership functions by coding elements of the 
membership functions into chromosomes; or (ill) chang- 
ing a level of an input of the parameters and a level of an 
output of the fuzzy inference system. 
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Description 

Background of tlie Invention 

Field of the Invention 

[0001] The invention relates to a method of optimiz- 
ing a control device using fuzzy inference system so 
that a controlled system can be controlled. 

Description of the Related Art 

[0002] In the past, optimum values of the character- 
istics of a fuzzy controller (that is, values of the parame- 
ters such as the number, shape, position and/or 
expanse of membership functions, the fuzzy rules, and 
the standardized coefficients for input and output val- 
ues) to control a controlled system were determined by 
experiment or experience in a design stage or a setting 
stage before shipment so that when use environment 
and user are supposed for a product that will be a con- 
trolled system, the supposed characteristics (prefer- 
ence, ability, personality, and use condition) of a use 
environment and a user can be met. 
[0003] However, with the advent of diverse and 
highly advanced control technique, the conventional 
method of experimentally deciding optimum values for 
the characteristics of a fuzzy controller increases diffi- 
culty to optimize the fuzzy controller and needs to have 
a lot of time. Moreover, since use environment of prod- 
ucts, disturbance or user's personality differs from indi- 
vidual to individual, the method does not enable all the 
users to satisfy the products of the characteristics. 

Summary of the Invention 

[0004] To solve the problem, methods can be con- 
sidered which, using fuzzy inference, neural networks, 
or heuristic rules, optimize output characteristics of a 
fuzzy controller that controls a controlled system in 
according to expected characteristics of use environ- 
ment and users with a narrow range of variations which 
is also expected in advance. Since the methods can 
optimize the characteristics of the fuzzy controller in real 
time, the controller can handle variations of the charac- 
teristics of use environment and users. 
[0005] However, the methods mentioned above 
have a problem in that when an variation of the charac- 
teristics of use environment and users, which cannot be 
expected when designing the system, takes place, the 
characteristics of the fuzzy controller cannot be opti- 
mized. The problem occurs not only in fuzzy controllers 
but also in controllers themselves having a fuzzy infer- 
ence system. An embodiment of the present invention 
resolves the problem. Even when variations of charac- 
teristics of use environment and users occur, a control 
device having a fuzzy inference system can be opti- 
mized in real-time while the control device controls the 



controlled system, or the controlled system is being 
operated or on-line. 

[0006] The method of real-time optimization of the 
control device in accordance with an embodiment of the 

5 invention (a) codes into chromosomes parameters used 
in a fuzzy inference system, which determines an output 
associated with a manipulated variable of a machine 
(controlled system) based on preselected input signals, 
and (b) optimizing in real time the output of the control 

10 device using evolutionary computation. 

[0007] Evaluation of the evolutionary computation 
can be made based on evaluation criteria selected 
beforehand, or users intention. 
[0008] The parameters may be (i) the number, 

IS shape, position and/or expanse of membership func- 
tions for the fuzzy inference system of the control 
device, (ii) fuzzy rules, or (iii) standardized coefficients 
for input and output values. 

[0009] The fuzzy rules can be compiled in the form 
20 of a fuzzy rule matrix. The configuration of the matrix 
may be defined by membership functions. Each section 
of the matrix represents a fuzzy rule which is a parame- 
ter having a value. The type of parameter and a value of 
the parameter are referred to as "a parameter". 
25 [0010] Coding into chromosomes can be made on 
all of the parameters or part thereof selected for the 
fuzzy controller. 

[0011] Selection of part of the parameters can be 
carried out stochastically or deterministically starting 

30 from a membership function or a fuzzy rule having the 
highest total values of fitness in a fixed interval of time, 
which is the most frequently used parameters, until a 
preselected number of parameters are selected. To be 
specific, for example, a roulette selection of five posi- 

35 tional parameters for membership functions are made 
proportional to the ratio of their total values of fitness to 
the overall fitness, or a selection of parameters for an 
expanse of membership functions is made in the order 
of size so that a total value of fitness can occupy over 80 

40 percent of the entirety 

[0012] In selecting part of parameters, only some 
parameters that exceed a threshold of fitness fixed 
regarding the parameters can be selected. To be con- 
crete, for example, depending on the ratio of a total of 

45 fitness to the entirety, a roulette selection of five fuzzy 
rules are made, or a selection of fuzzy rules are made in 
the order of size so that a total of fitness occupies over 
80 percent of the entirety. 

[0013] In deciding a threshold, the threshold can be 
50 made higher or lower depending on the numbers 
selected or the time spent till a selection is made. 
[0014] As the fuzzy inference system, a minimax 
center-of-gravity method, an algebraic sum addition 
center-of-gravity method, a simplified inference method, 
55 a inference method having the degree of conviction, or 
a functional inference method can be employed. As the 
membership function, a one-dimensional membership 
function and/or a multi-dimensional membership func- 
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tion can be used. 

[0015] As the evolutionary calculation, a genetic 
algorithm, an evolutionary strategy or an evolutionary 
programming may be used. 

[0016] For purposes of summarizing the invention 
and the advantages achieved over the prior art, certain 
objects and advantages of the Invention have been 
described above. Of course, It Is to be understood that 
not necessarily all such objects or advantages may be 
achieved In accordance with any particular embodiment 
of the invention. Thus, for example, those skilled in the 
art will recognize that the invention may be embodied or 
carried out in a manner that achieves or optimizes one 
advantage or group of advantages as taught herein 
without necessarily achieving other objects or advan- 
tages as may be taught or suggested herein. 
[0017] Further aspects, features and advantages of 
this invention will become apparent from the detailed 
description of the preferred embodiments which follow. 

Brief Description of the Drawings 

[0018] These and other features of this invention 
will now be described with reference to the drawings of 
preferred embodiments which are Intended to illustrate 
and not to limit the invention. 

Figure 1 is a schematic diagram showing an 
embodiment of the optimization method according 
to the present invention. 

Figure 2 Is a block diagram showing one embodi- 
ment of a control device utilizing an optimization 
method in accordance with the invention. 
Figures 3 Is a figure illustrating a control device and 
a outboard motor including a trimming apparatus. 
Figure 4 is a block diagram Illustrating a boat con- 
trol apparatus and an outboard motor where the 
boat control apparatus is a control device and the 
outboard motor is a controlled system. 
Figure 5 illustrates relationship between standard- 
ized coefficients of a boat operation fuzzy control 
module and individuals produced by encoding 
them. 

Figure 6 illustrates relationship between a fuzzy 
control table of a boat operation fuzzy control mod- 
ule and individuals produced by encoding part of It. 
Figure 7 is a flowchart Illustrating evolutionary proc- 
ess by a control device. 

Figure 8 Is a graph illustrating one example of per- 
forming time division when a plurality of individuals 
are evaluated by time division. 
Figure 9 illustrates one example of an Interface for 
switching between regular control mode and evolu- 
tionary mode. 

Figure 10 Illustrates one example of seeking a total 
of fitness of fuzzy rules. 

Figure 1 1 is a flowchart illustrating an evolutionary 
computation module when generic algorithm is 



used as an evolutionary computation method. 
Figure 12 is a flowchart illustrating an evolutionary 
computation module when evolutionary strategy is 
used as an evolutionary computation method. 
5 Figure 13 is a flowchart illustrating an evolutionary 

computation module when evolutionary program- 
ming is used as an evolutionary computation 
method. 

Figure 14 Is another embodiment In accordance 
10 with the invention. 

Figure 15 is still another embodiment in accordance 
with the invention. 

Figure 16 is still another embodiment In accordance 
with the invention. 

75 

Detailed Description of the Preferred Embodiment 

[0019] Figure 1 is a diagram showing an embodi- 
ment of the method of real-time optimization of a control 
20 device provided with a fuzzy Inference system for con- 
trolling a machine. The fuzzy inference system com- 
prises a matrix of fuzzy rules which are regulated by 
preselected parameters. The method comprises the 
steps of: 

25 

(a) operating the machine using the fuzzy inference 
system of the control device; 

(b) optimizing in real-time the Input-output relation- 
ship of the fuzzy inference system by at least one of 

30 the following: (i) revising the fuzzy rule matrix by 
extracting a section from the matrix and coding ele- 
ments of the section into chromosomes; (ii) modify- 
ing the configuration of the fuzzy rule matrix defined 
by membership functions by coding elements of the 

35 membership functions Into chromosomes; or (iii) 
changing a level of an Input of the parameters and 
a level of an output of the fuzzy inference system, 
wherein the chromosomes are subjected to evolu- 
tionary computation, whereby at least one fitted 

40 individual is selected based on user's ultimate 
choice or a pre-selected target; and 

(c) operating the machine using the optimized fuzzy 
inference system. 

45 [0020] In the above, the method may further com- 
prise monitoring the fuzzy rule matrix In use while oper- 
ating the machine, and evaluating the section extracted 
in (ii) or the membership functions to be modified in (iii). 
[0021] Some embodiments of the method for real- 

50 time optimization of a control device having a fuzzy 
inference system in accordance with the invention (sim- 
ply called "the optimization method" hereinafter) will be 
explained herein below, referring to the embodiments in 
the accompanied figures. 

55 [0022] Figure 2 Is a block diagram showing one 
embodiment of a control device utilizing the optimization 
method in accordance with the invention. A control 
device 10 Includes an interactive evolutionary process 
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unit 14, an autonomous evolutionary process unit 15, an 
evaluation unit 16, and a fuzzy control module 17. The 
evaluation unit 16 is connected to the autonomous evo- 
lutionary process unit 15, which, together with the inter- 
active evolutionary process unit 14, Is connected to the 
fuzzy control module 17. A controlled system 13 
includes a device 18, which is connected to the fuzzy 
control module 17. The controlled system 13 is con- 
nected to the evaluation unit 1 6 and applies output to 
the evaluation unit 16 and a user 12. 
[0023] The fuzzy control module 17 receives infor- 
mation from an external information input 11, and 
parameter changes from the interactive evolutionary 
process unit 14 and the autonomous evolutionary proc- 
ess unit 15, and outputs to the controlled system 13 an 
control output as a manipulated variable, including com- 
pensated amount or compensation coefficients. The 
fuzzy control module 17 may be a so-called fuzzy con- 
troller, but is not limited to it. The fuzzy control module 
1 7 can be any control module as far as the control mod- 
ule adopts a fuzzy inference system; for example, the 
fuzzy control module 17 can be a module that adopts a 
fuzzy intention decision system or a fuzzy neural con- 
troller. 

[0024] The interactive evolutionary process unit 14 
and the autonomous evolutionary process unit 15 opti- 
mize the parameters on a fuzzy inference system in the 
fuzzy control module 17, while the controlled system 13 
is working, that is. In real time. The parameters to be 
optimized can be any type of parameter as long as the 
parameters are related to a fuzzy inference system. For 
example, cited as such are the parameters for deciding 
the number, shape, position and expanse of member- 
ship functions, the fuzzy rules, and the standardized 
coefficients for input and output values. 
[0025] With regard to evaluation for optimization, 
the interactive evolutionary process unit 14 receives 
evaluation value applied by the user 12, and the auton- 
omous evolutionary process unit 1 5 accepts evaluation 
values from the evaluation unit 16 which is designed 
beforehand based on predetermined evaluation criteria 
[0026] Thus, since the parameters regarding the 
fuzzy inference system are optimized in real time, the 
invention can handle users' preferences or various 
types of use environment, which eliminates limitations 
imposed on the controlled system using a fuzzy infer- 
ence system. 

[0027] Next, some embodiments where the optimi- 
zation method in accordance with the invention is 
applied to a controlled system will be explained below. 
Figures 3-14 show an embodiment where the optimiza- 
tion method is applied to a outboard motor for a planing 
boat and a trimming apparatus. 
[0028] Figures 3 is a figure illustrating a control 
device and a outboard motor including a trimming appa- 
ratus. A outboard motor 22 is mounted to a hull 21 . The 
outboard motor 22 includes an engine 23 for operating 
the hull 21 and a trimming apparatus for controlling the 
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cruising direction of the hull 21. The engine 23 has an 
electronic throttle valve 24 for controlling the speed 
thereof. The trimming apparatus contains a hydraulic 
cylinder 26 and a hydraulic pump 27. The outboard 

5 motor 22 is connected to an control device 20. 

[0029] The control device 20 optimizes boat opera- 
tion characteristics which realize a constant speed nav- 
igation control in response to changes in the movement 
of the hull 21 and disturbances. The control device 20 

10 also optimizes the boat operation characteristics, by 
responding to preferences of users-when the users are 
different, or when the preferences of even one and the 
same user vary dependent on time, for example, when 
his preferences vary in spring or fall. The "boat opera- 

15 tion characteristics" herein mean boat speed control 
characteristics by the operations of the electronic throt- 
tle valve 24 and the trimming apparatus 25. 
[0030] The control device 20 inputs the engine 
speed, the speed, acceleration, steering angle, and 

20 throttle opening of the hull 21 , and the evaluation value, 
and outputs an electronic throttle valve opening varia- 
tion and a trim angle variation to operate the electronic 
throttle valve 24 and the trimming apparatus 25, respec- 
tively, which controls intake of air and posture of the hull 

25 for constant speed navigation control. 

[0031 ] Figure 4 Is a block diagram Illustrating a boat 
control apparatus and an outboard motor where the 
boat control apparatus is a control device and the out- 
board motor is a controlled system. A boat control appa- 

30 ratus 30 includes an interactive evolutionary process 
unit 34, an autonomous evolutionary process unit 35, an 
evaluation unit 36, and a boat operation fuzzy control 
module 37. The evaluation unit 36 is connected to the 
autonomous evolutionary process unit 35, which, 

35 together with the interactive evolutionary process unit 
34, is connected to the boat operation fuzzy control 
module 37. An outboard motor 33 includes an electronic 
throttle 38 and a trimming apparatus 39, both of which 
are connected to the boat operation fuzzy control mod- 

40 ule 37. The outboard motor 33 is connected to the eval- 
uation unit 36 and applies boat operation performance 
to the evaluation unit 36 and a user 32. 
[0032] The evaluation unit 36 outputs an evaluation 
value to evaluate the autonomous evolutionary process 

45 unit 35. The autonomous evolutionary process unit 35 
optimizes standardized coefficients-the coefficients that 
adjust the size of input and output information-for the 
boat operation fuzzy control module 37. The interactive 
evolutionary process unit 34 inputs evaluation value 

50 from the user 32 and optimizes fuzzy rules for the boat 
operation fuzzy control module 37. The boat operation 
fuzzy control module 37 outputs an electronic throttle 
valve opening variation and a trim angle variation in 
response to output from an external information input 

55 31 , change of fuzzy rules from the interactive evolution- 
ary process unit 34, and change of standardized coeffi- 
cients from the autonomous evolutionary process unit 
35. 
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[0033] The boat operation fuzzy control module 37 
employs a simplified inference method as a fuzzy infer- 
ence system, and outputs an electronic throttle valve 
opening variation and a trim angle variation in response 
to the engine speed, speed, acceleration, and steering 
angle. A fuzzy rule table can be designed based on the 
boat operation knowledge of the skilled. The fuzzy rule 
is expressed by real number values. 
[0034] Figure 5 illustrates relationship between 
standardized coefficients of the boat operation fuzzy 
control module 40 (corresponding to reference numeral 
37 in Figure 4) and individuals produced by encoding 
them. The speed is applied to standard coefficient S1; 
the acceleration, S2: the throttle opening, S3; the steer- 
ing angle, S4; the engine speed, S5. Each of the Infor- 
mation is applied to the boat operation fuzzy control 
module 40 through its corresponding standard coeffi- 
cient. The boat operation fuzzy control module 40 out- 
puts the electronic throttle valve opening variation and 
the trim angle variation through the corresponding 
standard coefficient S6 and S7, respectively. 
[0035] The autonomous evolutionary process unit 
35 uses a genetic algorithm, and encodes the standard- 
ized coefficients of the boat operation fuzzy control 
module 40 as shown in Figure 5 to produce individuals. 
The autonomous evolutionary process unit 35 optimizes 
the standardized coefficients by using the genetic algo- 
rithm. With regard to evaluation of each individual dur- 
ing autonomous evolutionary process, about boat 
operating characteristics, higher evaluation values are 
provided by the evaluation unit 36 as an error between 
an actual speed and a reference a user has fixed gets 
closer to a desired range. As a result, the standardized 
coefficients of the boat operation fuzzy control module 
37 are automatically optimized towards the desired boat 
operating characteristics, and an optimal boat operating 
characteristic is obtained even when the use environ- 
ment changes or the hull moves inappropriately. 
[0036] Thus, the method, by which the evalijation in 
evolutionary process is made by the evaluation unit 36 
designed beforehand and the optimization is automati- 
cally performed, is called autonomous evaluation 
herein. 

[0037] Figure 6 Illustrates relationship between a 
fuzzy rule table of the boat operation fuzzy control mod- 
ule and individuals produced by encoding part of it. The 
autonomous evolutionary process unit 34 uses a 
genetic algorithm, by which part of the fuzzy rule table 
for the boat operation fuzzy control module 37 is 
encoded to produce the individuals, and optimizes the 
part of the fuzzy rule table using the genetic algorithm. 
The evaluation of each of the individuals during interac- 
tive optimum process Is done based on the comfortable- 
ness of the ride the user experiences. As a result, the 
part of the fuzzy rule table Is optimized based on the 
evaluation of the user to produce an optimal boat oper- 
ating characteristic suitable for the user's evaluation. 
[0038] The method the user employs about the 



evaluation in evolutionary process is called interactive 
evaluation herein. The evolutionary process in the boat 
control apparatus 30 will be explained below. 
[0039] Figure 7 is a flowchart illustrating evolution- 

5 ary process by the boat control apparatus 30 as a con- 
trol device. The boat control apparatus 30, in doing 
evolutionary process, performs an autonomous evalua- 
tion by the autonomous evolutionary process unit 35 
and an interactive evaluation by the interactive evolu- 

10 tionary process unit 34. 

[0040] When evaluation methods are different, the 
flows of optimal process will be different. Accordingly, 
an evolutionary process adopting an autonomous eval- 
uation method and an evolutionary process employing 

IS an interactive autonomous evaluation method are 
explained individually. 

a. Evolutionary process in an autonomous evolutionary 
process unit 

20 

[0041] As shown in Figure 7, initial values of the 
standardized coefficients are determined at random 
within a range decided beforehand to produce first gen- 
eration comprising a plurality of initial Individuals (step 

25 1-1). A constant speed navigation evaluation about all 
the individuals in the first generation is performed (step 
1-2). The constant speed navigation evaluation is 
explained here. A plurality of individuals are operated in 
parallel by time division and evaluation values are com- 

30 pared by a total of the duration. 

[0042] Figure 8 is a graph illustrating one example 
of performing time division when a plurality of individu- 
als are evaluated by time division. As shown in the fig- 
ure, ten individuals are controlled every one minute, and 

35 absolute values of the difference between a reference 
and an actual speed are totaled every sampling time. 
Making this one cycle, twenty cycles are repeated to 
calculate a total within an evaluation period as an eval- 
uation value. By doing so, since influence by distur- 

40 bances such as atmospheric phenomena and oceanic 
phenomena (for example, wind, or wave) is understood 
as a total through the individuals, a fair evaluation of 
characteristics of each individual can be made. 
[0043] Based on the evaluation value of each indi- 

45 vidual derived by the evaluation value calculation proc- 
ess (step 1-2), it is evaluated whether the evaluation 
value is an optimal boat operation characteristic (step 1- 
3). As a result of the evaluation, it is decided whether an 
optimal boat operation characteristic is obtained (step 

50 1-4). If the optimal boat operation characteristic is 
obtained, the evolutionary process is finished. If not, the 
process proceeds to an evolutionary calculation module 
to generate individuals of the next generation (step 1-5). 

55 b. Evolutionary process in an interactive evolutionary 
process unit 

[0044] Figure 9 illustrates one example of an inter- 
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face for switching between regular control mode and 
evolutionary mode. As shown in Figure 7, the interactive 
evolutionary process unit has two modes: a regular con- 
trol mode and an evolutionary mode. The switching 
(step 2-1) between the regular control mode and the 
evolutionary mode Is made in accordance with the con- 
ditions fixed beforehand, for example, time or user's 
intention through an interface shown in Figure 9. 
[0045] Figure 1 0 illustrates one example of seeking 
a total of fitness of fuzzy rules. The regular control mode 
performs fuzzy control using a fuzzy rule table estab- 
lished at the time, and at the same time seeks a total of 
fitness of the fuzzy rules till evolutionary mode is 
switched on (step 2-2). To be specific, as shown in Fig- 
ure 10, calculation results of the fitness table for calcu- 
lating the fitness of each fuzzy rule at a certain time are 
added to the total table for calculating a total of fitness 
till the evolutionary mode is switched on (step 2-3), 
which is terminated at the time the evolutionary mode is 
switched on. 

[0046] When the evolutionary mode is switched on, 
as shown in Figure 6, referring to the total table an arbi- 
trary number of fuzzy rules are encoded into chromo- 
somes in the order of higher total (step 2-4), which, as 
initials, are added to perturbation following a normal dis- 
tribution to produce a first generation comprising a plu- 
rality of initial individuals (step 2-5). A trial ride is made 
using parameters for any individual in the first genera- 
tion (step 2-6). The user inputs an evaluation value for 
the individual (step 2-7). 

[0047] Based on the evaluation value, it is decided 
whether a desired boat operation characteristic is 
obtained (step 2-8). If it is, the individual is regarded as 
best and the evolutionary process is terminated. If it is 
not, it is decided whether a trial ride and an evaluation 
about all the individuals in the first generation are fin- 
ished (step 2-9). If the trial ride and the evaluation about 
all the individuals are not finished, the fuzzy rules of the 
fuzzy control module are changed to those of other indi- 
viduals (step 2-10) and a ride is tried once again (step 
2-6). If they are, it is judged whether a stipulated gener- 
ation is reached (step 2-1 1 ). If it is judged so, the indi- 
vidual with the highest evaluation value in the 
generation is considered to be best and the evolutionary 
process is ended. If it is not judged so, the evolutionary 
calculation module begins (step 2-12) to produce indi- 
viduals to the next generation and m^ke a trial ride and 
an evaluation using the fuzzy rules for the individuals. 
[0048] The above process, by which the desired 
boat operation characteristics are obtained, is repeated 
till the number of stipulated generations is reached. As 
a result, a part of the ftjzzy rule table for the boat opera- 
tion fuzzy control module Is replaced by the fuzzy rules 
for the individuals obtained, and the total table is initial- 
ized to zero (step 2-13). 

[0049] Then, when the regular control mode is 
switched on again, the fuzzy control is performed by 
using the fuzzy rule table replaced, and a total of fitness 



for each fuzzy rule at this time is sought till the evolution- 
ary mode is switched on. 

[0050] Repeating the above process enables the 
fuzzy rules with a higher total of fitness, i.e., the fuzzy 

5 rule in the region frequently used in the present environ- 
ment, to be optimized in concentration. Since a fuzzy 
rule in the region not frequently used does not need to 
be changed, stable control can be achieved even when 
the fuzzy rule is used. 

10 [0051] Now, some of evolutionary computation 
modules will be exemplified. 

a. Genetic Algorithm (GA) 

IS [0052] Figure 1 1 is a flowchart illustrating an evolu- 
tionary computation module when generic algorithm is 
used as an evolutionary computation method. In the 
module, when a desired characteristic is not obtained 
after completion of the evaluation of all the individuals to 

20 one generation, a group of individuals to the next gener- 
ation is produced. 

[0053] With respect to scaling (step 1), a linear 
transformation of fitness is performed so that the ratio of 
an average fitness to a maximum fitness in a individual 

25 group may be constant. 

[0054] As for selection, a roulette selection system 
can be adopted that selects stochastically in propor- 
tional to user's evaluation (fitness). A tournament selec- 
tion system can also be employed that selects one with 

30 the best evaluation in the N individuals selected at ran- 
dom. 

[0055] Regarding crossover (step 3), there are 
methods such as one-point crossover, two-point crosso- 
ver, and normal-distribution crossover. It happens that a 

35 selected parent for crossover is the same individual. 
When this situation is left as is, diversity as a individual 
group is lost. Therefore, if a parent selected for crosso- 
ver is the same individual, crossover for the same indi- 
vidual should be avoided as much as possible by 

40 replacing the individual with another selected individual. 
[0056] As for mutation (step 4), values are changed 
at random with a constant probability about each locus 
for individuals. There is also another method by which 
perturbation having normal distribution can be added. In 

45 the case where different individuals are selected as par- 
ents for crossover and the different individuals are 
genetically the same, mutation takes place with higher 
probability than usual for both of the parents to be 
crossed over. 

50 [0057] In addition to that mentioned above, a 
method of the alternation of generations called "regen- 
eration," which replaces all the individuals to one gener- 
ation one time, may be employed. 
[0058] When the alternation of generations is 

55 applied strictly, there is a possibility that an individual 
with high evaluation may be destroyed. Accordingly, 
elite preservation strategy can be used together that 
unconditionally leaves the elite (any number of individu- 
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als that have acquired high evaluation) to the next gen- 
eration. 

b. Evolutionary Strategy (ES) 

[0059] Figure 12 is a flowchart illustrating an evolu- 
tionary computation module when evolutionary strategy 
Is used as an evolutionary computation method. The 
module produces an Individual group for the next gener- 
ation, after completing evaluation of all the Individuals to 
one generation, when a desired characteristic is not 
obtained. 

[0060] As for selection (step 1), two exemplary 
kinds of methods are explained since methods of selec- 
tion are different owing to the kinds of evolutionary strat- 
egy. 

(ji, X)-ES: This evolutionary strategy determlnlstl- 
cally selects n individuals In the order of better fit- 
ness from X child individuals produced by \i parent 

individuals. 

(H + X)-ES: This evolutionary strategy deterministi- 
cally selects \i individuals in the order of better fit- 
ness from (i parent individuals and X child 
Individuals combined. 

[0061] In addition to the methods mentioned above, 
evolutionary strategy includes other methods below. 
When these methods are used, a selection suitable for 
the methods should be made. 

• (1,1) -ES: Random Walk (RW) 

• (1 +1)-ES: Hill Climbing (HC) 

• (1 , X) -ES, (1 + ?)-ES: Adjacent search method 

((i + X) -ES: Successive generation multi-point 
search method 

[0062] Regarding crossover (step 2), the normal 
distribution is used. Parents' values can be succeeded 
for each parameter, and child's values can be a middle 
point, interpolated point or extrapolated point. 
[0063] With respect to mutation (step 3), perturba- 
tion having the normal distribution Is added to each 
parameter. The dispersion of the normal distribution 
may be adjusted every parameter or may have interrela- 
tionship between parameters. 

[0064] Since the evolutionary strategy (ES), as 
explained above, uses each parameter as a real 
number, it has the advantage that a transformation from 
phenotype to genotype is no longer necessary. Using a 
method of crossover having continuity of real numbers 
such as normal distribution crossover enables parents' 
character to be reflected more heavily to child's charac- 
ter than the binary code frequently used in genetic algo- 
rithm or the gray code crossed over at one point or 
many points. 
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c. Evolutionary Programming (EP) 

[0065] Figure 13 is a flowchart illustrating an evolu- 
tionary computation module when evolutionary pro- 

5 gramming is used as an evolutionary computation 
method. With regard to scaling (step 1), when the 
number of individuals is ji, the 2\i individuals, combined 
with the individuals before perturbation is added and the 
individuals after perturbation is added, are compared 

10 with the q individuals selected at random. The superior 
number is defined as fitness of the individuals. 
[0066] In selection (step 2), |i individuals are 
selected in the order of good fitness from individual 
groups produced. The selection is deterministic, but 

15 since scaling Is stochastic, the selection is substantially 
stochastic. 

[0067] Since the evolutionary programming (EP) 
mentioned above uses each parameter as a real 
number, it has the advantage that a transformation from 

20 phenotype to genotype Is no longer necessary As no 
crossover is used, there Is no limitation in phenotype. 
The parameters of the genetic algorithm should not be 
in a sting as in the evolutionary strategy, and may be In 
a tree structure. 

25 [0068] The use environment of the planing boat in 
the embodiments can be varied remarkably owing to the 
change of weathers or seasons. The preference of 
users varies significantly. Therefore, It Is impossible to 
acquire boat speed control characteristics all users can 

30 be satisfied with under every use environment, in the 
design stage or the setting stage before shipment. 
Since an outboard motor and a hull are manufactured 
individually, throttle control and trim angle control for the 
hull are indispensable so as to achieve optimal boat 

35 speed control. In addition to the characteristics of use 
environment and a user. When a fuzzy controller Is used 
as a control device, It Is difficult to optimize the charac- 
terisfics of the fuzzy controller to fit all conditions. How- 
ever, as described above, because the parameters for 

40 the boat operaUon fuzzy control module which controls 
an electronic throttle valve and a trim may be optimized 
in real time by using the evolutionary calculation, the 
invention has the advantage that the boat control can be 
achieved that suits all conditions. 

45 [0069] The controlled system that can be optimized 
by the optimization method In accordance with the 
Invention Is not limited to the outboard motor and the 
trimming apparatus of the planing boat shown In Fig- 
ures 3-14. The controlled system can be any controlled 

50 system as far as it is controlled by a control device that 
has a fuzzy inference system, for example, the control- 
led system shown in Figures 14-15. 
[0070] Figure 14 shows an embodiment where the 
optimization method in accordance with the invention is 

55 applied to a control device that controls the movement 
of a rot}ot. In the embodiment, the control device 132 
inputs Information from an Infrared sensor attached to 
the robot 131 , an image Input device such as a camera. 



7 



EP 1 085 460 A2 14 



13 

a voice input device such as a microphone, and an 
accelerator sensor. The control device 132 includes a 
fuzzy control module (not shown) which outputs infor- 
mation on the movement for the robot 131. The fuzzy 
control module can be optimized in real time. 
[0071] The parameters to be optimized may 
selected arbitrarily. Evaluation for optimization is made 
directly by a user through an appropriate input device. 
The Input device to which the user will apply evaluation 
can be provided separately. For example, the Input 
device may be constructed to detect the state of the 
user by the image input device and the voice image 
input device, and based on the detection results, to rec- 
ognize the evaluation of the user. The construction 
brings about the advantage that the robot's movement 
can be optimized as if the robot were understanding the 
user's intention. 

[0072] In this way, when the optimization method 
according to the invention is applied to the control 
device that controls the movement of the robot, the 
robot can execute optimal movements, according to a 
change of robot's bodies (for example, a change from a 
human-type robot to a dog-type robot), a change of use 
environments, and user's preference. 
[0073] Figure 15 shows an embodiment where a 
head, arms, and/or legs of a robot 141 may be inter- 
changeably mounted to a body thereof. The body 142 of 
the robot 141 contains a control device 143 that controls 
the movement of each part. When the optimization 
method in accordance with the invention is applied to 
the control device 143, even if the head, arms, and/or 
legs are interchanged, the control device 143 can be 
optimized so that an optimal movement may be made 
according to a specified part mounted. Accordingly, 
since the limitations to the parts of the robot 141 are 
reduced, Interchange of the parts can be easily made. 
Thus, the advantages are provided that the robot 141 
itself can perform various types of jobs or entertainment 
movements only by interchanging the parts, which 
increases availability of the robot 141 . 
[0074] Figure 16 shows an embodiment where the 
optimization method in accordance with the invention is 
applied to a control device 153 of a bicycle 151 with an 
electrically-driven auxiliary power unit 152. The control 
device 153, Including a fuzzy control module, receives a 
stepping force for a pedal from a user, a speed, an 
acceleration, and an evaluation value, and outputs an 
assist force to the electrically-driven auxiliary power unit 
152, decided by the fuzzy control module. The fuzzy 
control module is optimized in real time. 
[0075] Since the optimization method in accord- 
ance with the invention is applied to the control device 
153 of the bicycle 151 with the electrically-driven auxil- 
iary power unit 152, even if the bicycle 151 may be inter- 
changed to a new bicycle to which the control device 
153 is attached, the assist force can be optimized in real 
time for the new bicycle, which reduce the limitations to 
the kinds of bicycle. Even when a bicycle and an electri- 



cally-driven auxiliary power unit are manufactured inde- 
pendently, the electrically-driven auxiliary power unit 
can easily be adapted to each of the bicycles. The 
advantage is provided that in accordance with the pref- 

5 erence to use environment, age or physique of a user, 
an assist force, or duration of a battery, a control device 
Is optimized in real time so that an optimal assist force 
may be generated. As far as an apparatus has an elec- 
trically-driven auxiliary power unit, the same effect can 

10 be obtained from any apparatus, for example, a wheel- 
chair. 

[0076] in the embodiments explained above, the 
optimization method in accordance with the invention is 
applied to the fuzzy controller which outputs the manip- 

15 ulated variable (the electronic throttle valve opening var- 
iation and trim angle variation) of the controlled system. 
However, the invention is not limited to the embodi- 
ments, and is applicable to a control device having any 
fuzzy inference system so long as the control device 

20 includes a fuzzy inference system that decides output 
concerning a manipulated variable. The control device 
for example, may be the one that contains a fuzzy infer- 
ence system for deciding the coefficients of a manipu- 
lated variable or a compensated amount. In addition, 

25 the invention is applicable to a control device having a 
fuzzy intention determination system and a fuzzy neural 
controller. 

[0077] The optimization method in accordance with 
the invention encodes the parameters concerning the 
30 fuzzy inference system of the control device into chro- 
mosomes, optimizing in real time using evolutionary cal- 
culation, and optimizes the control device against 
unexpected parameter variations of the controlled sys- 
tem and disturbances. Accordingly, the advantage is 
35 provided that optimal control of a controlled system can 
be performed in accordance with all use environments 
and characteristics of a user. 
[0078] By mal<ing the parameters that are coded 
into chromosomes a part of parameters on a fuzzy infer- 
no ence system, the advantage is produced that only 
parameters necessary for adaptation can be extracted, 
search spaces can be limited, and an optimization can 
be made at high speeds, without destroying parameters 
unnecessary for optimization. 
45 [0079] When a total of fitness of a membership 
function (the degree input or output corresponds to the 
membership function within a predetermine period of 
time) is larger, it is considered that the membership 
function makes a great influence on inference. There- 
50 fore, by deterministically or stochastically selecting the 
parameters to be encoded into chromosomes depend- 
ing on a total of fitness of the membership function 
within any period of time, for example, a certain number 
of parameters are selected in the order of the larger 
55 total of fitness, and optimizing them, the advantage is 
obtained that optimal control is possible without optimiz- 
ing all parameters. 

[0080] When a total of fitness of a fuzzy rule (the 
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degree a fuzzy rule in a rule table is fired within a prede- 
termine period of time) is larger, it is considered that the 
fuzzy rule makes a great influence on inference. There- 
fore, by deterministically or stochastically selecting the 
parameters to be encoded into chromosomes depend- 
ing on a total of fitness of the fuzzy rule within any 
period of time, for example, some parameters having 
the larger total of fitness are selected, and optimizing 
them, the advantage Is obtained that optimal control is 
possible without optimizing all parameters. 
[0081] By selecting only parameters beyond a 
threshold of fitness determined for the parameters, an 
easy adjustment can be made with regard to parameter 
selection. For example, setting a maximum threshold 
precludes selecting parameters that cannot be changed 
or need not be changed. 

[0082] By raising or lowering the threshold accord- 
ing to the number of times selected for the correspond- 
ing parameters, for example, by raising the threshold 
according to the number of times selected, the possibil- 
ity that the parameters with higher selected number of 
times will be selected can be reduced. In this way, an 
easy adjustment of parameter selection can be made, 
without destroying the parameters that have undergone 
optimization. 

[0083] By raising or lowering the threshold accord- 
ing to the time elapsed since the previous selection of 
the con-esponding parameters, for example, lowering 
the threshold according to the time elapsed, the possi- 
bility that the parameters have not selected since the 
previous selection will be selected can be enhanced. In 
this way, an easy adjustment of parameter selection can 
be made, which advances optimization of parameters 
that have not experienced optimization. 
[0084] It will be understood by those of skill in the 
art that numerous and various modifications can be 
made without departing from the spirit of the present 
Invention. Therefore, It should be clearly understood 
that the forms of the present Invention are Illustrative 
only and are not Intended to limit the scope of the 
present Invention. 

Claims 

1. A method of real-time optimization of a control 
device provided with a fuzzy inference system for 
controlling a machine, said fuzzy inference system 
comprising a matrix of fuzzy rules which are regu- 
lated by preselected parameters, said method com- 
prising the steps of: 

operating the machine using the fuzzy Infer- 
ence system of the control device; 
optimizing in real-time the input-output relation- 
ship of the fuzzy Inference system by at least 
one of the following: 

(1) revising the fuzzy rule matrix by extract- 
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ing a section from the matrix and coding 
elements of the section into chromosomes; 
(ii) modifying the configuration of the fuzzy 
rule matrix defined by membership func- 
5 tlons by coding elements of the member- 

ship functions into chromosomes; or 
(ill) changing a level of an input of the 
parameters and a level of an output of the 
fuzzy inference system, 

10 

said chromosomes being subjected to evolu- 
tionary computation, wherein at least one fitted 
individual is selected based on user's ultimate 
choice or a pre-selected target; and 
15 operating the machine using the optimized 

fuzzy Inference system. 

2. Method according to claim 1, further comprising 
monitoring the fuzzy rule matrix in use while operat- 

20 ing the machine, and evaluating the section 
extracted In (11) or the membership functions to be 
modified in (ill). 

3. A method of real-time optimization of a control 
25 device comprising a fuzzy inference system for con- 
trolling a machine, comprising: 

encoding parameters used in the fuzzy Infer- 
ence system into chromosomes, said fuzzy 
30 Inference system determining an output asso- 

ciated with a manipulated variable of the 
machine based on preselected Input signals; 
and 

optimizing the output of the control device by 
35 subjecting the chromosomes to evolutionary 

computation on a real-time basis. 

4. Method according to at least one of the preceding 
claims 1 to 3, wherein the parameters encoded Into 

40 chromosomes are a part of the parameters on the 
fuzzy Inference system. 

5. Method according to at least one of the preceding 
claims 1 to 4, wherein the parameters encoded into 

45 chromosomes include at least one of number, 
shape, position, and expanse of membership func- 
tions. 

6. Method according to at least one of the preceding 
50 claims 1 to 5, wherein the parameters encoded into 

chromosomes include fuzzy rules. 

7. Method according to at least one of the preceding 
claims 1 to 6, wherein the parameters encoded into 

55 chromosomes include standardized coefficients for 
input and output values. 

8. Method according to at least one of the preceding 
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claims 1 to 7, wherein the parameters to be 
encoded Into chromosomes are deterministically or 
stochastically selected according to a total of fit- 
ness for membership functions within any period of 



9. Method according to at least one of the preceding 
claims 1 to 8, wherein the parameters to be 
encoded into chromosomes are deterministically or 
stochastically selected according to a total of fit- io 
ness for fuzzy rules within any period of time. 



10. Method according to at least one of the preceding 
claims 1 to 9, wherein only parameters are selected 
that exceed a threshold of fitness determined is 
according to the parameters. 

11. Method according to at least one of the preceding 
claims 1 to 10, wherein the threshold is raised or 
lowered according to selected number of times for 20 
corresponding parameters. 

12. Method according to at least one of the preceding 
claims 1 to 11 , wherein the fuzzy module is a so- 
called fuzzy controller, or any module that has a 25 
fuzzy Inference system, like a module with a fuzzy 
decision system or a fuzzy neuro-controller. 

13. Method according to at least one of the preceding 
claims 1 to 12, wherein the controlled object is an 30 
outboard engine with trimming device, a robot or a 
bicycle with a motor-assisted power system. 
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